Relative Profit - a New Metric to Evaluate the Performance of Stock Price Forecasting Models

Stock price forecasting models with lower Mean Squared Error (MSE) are more “welcome" than those who have higher MSE. However, this “welcome" may disappear when lower MSE leads to an unexpected loss whereas higher MSE leads to a positive profit in a practical investment. The reason is that MSE aims to evaluate models in the view of “accuracy", which has nothing to do with profit. We therefore propose the concept of “forecasting efficiency" that aims to evaluate models in the view of investment or profit. A comprehensive but concise metric: Relative Profit (RP) is designed to better evaluate which model really pleases investors. Finally, a comparison is made between RP and other popular metrics to demonstrate that RP is a good supplement to forecasting model evaluation.